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Abstract 

We consider the structures given by repeatedly generalising the definition of finite 
state automata by symmetry considerations, and constructing analogues of the 
transition monoid at each step. This approach first gives us non- deterministic 
automata, then (non- deterministic) two-way automata and bounded Turing ma- 
chines — that is, Turing machines where the read / write head is unable to 
move past the end of the input word. 

In the case of two-way automata, the transition monoids generalise to endo- 
morphism monoids in compact closed categories. These use Girard's resolution 
formula (from the Geometry of Interaction representation of linear logic) to 
construct the images of singleton words. 

In the case of bounded Turing machines, the transition homomorphism gen- 
eralises to a monoid homomorphism from N to a monoid constructed from the 
union of endomorphism monoids of a compact closed category, together with an 
appropriate composition. These use Girard's execution formula (also from the 
Geometry of Interaction representation of linear logic ) to construct images of 
singletons. 

AMS Classification: 68Q05, 86Q70, 18D15 

1 Introduction 



In what follows, we take one of the simplest possible definitions in the theory of 
computation — that of a deterministic finite state automaton without specified 
initial or terminal states — and repeatedly generalise the definition by symme- 
try considerations. Each successive generalisation leads to a more complicated 
structure, albeit already known, if not widely studied. However, the way in 
which the algebraic models follow the generalisations is of more interest. 

This procedure allows us to form algebraic models of each of the structures 
under consideration, which appear to be, in each case, important tools in an- 
swering questions about these structures. It is also of interest to note that the 
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algebraic structures used are similar both to those used by theoretical physi- 
cists in their algebraic models of symmetries, and those used by logicians for 
representing the process of deduction. 

2 Generalising finite state automata 

We take as the starting point of our generalisation process the idea of a finite set 
of functions from a finite set to itself — that is, we consider a set Q, and a set 
of functions S from Q to Q. Algebraic models arise when we consider multiple 
function applications, hgf(a) = hg{b) = h(c) = d. We wish keep a track of this 
process, so we draw the above as 

hgf (a) i — * hg^f i-> h {c) gf i-> (d) hgf. 

Note that when we draw it this way, we do not forget the function we have just 
applied. This is because, intuitively, we consider forgetting information to be a 
computational step. 

Consider the following graphical representation of the action of the functions 
{/, g} on the set {a, b, c} 




Using a graphical representation, the action of string of function symbols can be 
thought of as 'following a labelled path through a diagram'. This is, of course, 
a finite state automaton; we refer the reader to [ p"5[ for the basic theory. The set 
X is the input alphabet, and the set Q is the set of states. As the name suggests, 
these are both finite. There is also a next state function, o : E x Q — > Q which 
we have been representing by function application. 

In ffl], the following model is given: The set of all words of £ form a monoid, 
with composition given by concatenation of strings, and the identity element 
given by the empty word, A. This monoid is denoted £*. Similarly, the set of 
all functions on Q, denoted PT(Q), is also a monoid. Formally, we identify a 
function / : Q — > Q with the subset of Q x Q given by {(/(<?), q) ■ q G Q}- The 
composition of this monoid is given by: (c, a) is a member of SR if and only 
if there exists some b with (c, b) a member of S and (6, a) a member of R; it 
is immediate that this composition is associative, and the identity of PT(Q) is 
the diagonal relation I = {(q,q) '■ q S Q}- 

The transition function t : S* — > PT(Q) is defined as follows: Let w be a 
string of function symbols from S. Then the pair (b, a) is a member of t(w) if 
and only if w(a) — b. From the computational interpretation of the function t, it 
is clear that t(u)t(v) = t(uv) and i(A) = /. Hence t is a monoid homomorphism. 
This, together with the fact that we know t(f) for all / in S allows us to describe 
t(w) for any w in E*. This then allows a characterisation of the words of S* 
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(i.e. composites of functions) that have the same action on the set Q. Hence 
we can identify words over the input alphabet to form a finite quotient of E*, 
called the transition monoid. The homomorphism t uniquely determines, and 
is uniquely determined by the transitions of the finite state automaton. Also, 
every monoid homomorphism from a finitely generated free monoid to a monoid 
of functions on a set determines a finite state automaton. 

2.1 Generalising to non-deterministic automata 

Consider the following transition diagram, , As the first step 

in our 'generalising by symmetry' process, we would like to have an operation 
that reversed all the arrows in this transition diagram, to define another finite 



it stands, this is not a finite state automaton. We required E to be a set of 
functions, and in the second diagram f(a) can be either a or b, and g{b) is not 
defined. We replace the requirement that members of S define functions on 
the set Q with the more general requirement that they define relations on Q 
— that is, they are arbitrary sets of pairs of elements of Q (an alternative, but 
equivalent, requirement is that members of E define functions from Q to the set 
of all subsets of Q, denoted P(Q) )■ 

This is the generalisation from deterministic automata to non- deterministic 
automata. With a deterministic automaton, there is exactly one next state, 
for any x E E and q E Q. With a non-deterministic automaton, there is a 
set of next states (which may be empty). We replace the next state function 
o : E x Q — > Q by the next-set-of-states function o : E x Q — > P(Q), where 
P(Q) denotes the set of all subsets of Q. 

We can define the transition homomorphism, as before; the transition ho- 
momorphism for a non-deterministic automaton is given by a homomorphism 
from E* to B(Q), the monoid of relations on Q. Note that every monoid homo- 
morphism from a finitely generated free monoid to a finite monoid of relations 
uniquely determines a (non-deterministic) finite state automaton. 

The mathematical representation of the 'reversing arrows' symmetry is an 
operation defined on monoids of relations, given by R >— > R, where (a, b) is in R 
if and only if (6, a) is in R. Now consider the relation t(x) for some x E E. The 
pair (6, a) is in t(x) if there is an arrow from state a to state b labelled by x, and 
the connection between the 'reversing arrows' operation, and the symmetry ( ) 
is then apparent. 

3 Generalising to two-way automata 

Recall that we drew transitions of a finite state automaton as a pointer labelled 
by a state moving from left to right over a string of symbols. This convention 




However, as 
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was chosen because we were writing function application on the left, which is in 
turn due to the Arabic basis of our number system. We would like to eliminate 
the asymmetry given by the arbitrary choice of direction; that is, we would 
also like to be able to consider transitions of the form ^ d 'hgf i— > h^ c 'gf i— > 
hg^ f i— > hgf( a \ so that in terms of a pointer moving over words, the direction 
of movement is reversed. 

Consider a (non-deterministic) automaton A with state set Q, input alphabet 
E, and next state function o; : £ x Q — > P(Q). We eliminate the directional 
asymmetry by introducing a right-moving next state function o r ; Q x £ — * 
P(Q). The interpretation of this is that the pointer labelled by a state may 
move either left or right on a word (or both — we allow for the possibility 
of non-determinism), and change state accordingly. So, the evolution of the 
system under time proceeds as follows: Consider a point in a computational 
process, . . . Xi-^Xi-% ( a > XiXi+i . . . The set of next configurations is the union 
of . . . Xi-2 ^ Xi-iXi . . . where b is in Xi-i o/ a and . . . Xi-iXi ^ Xi+\ . . . where 
c is in a o r xi. 

This structure is a two-way automaton. It is not described in the same way 
as the usual model, due to J.-C. Birget (see pjj); he labels the states as either 
left-moving, or right-moving (or both; the sets of left and right moving states are 
not assumed to be disjoint) and has a single next-state function. The movement 
of the pointer is then to the left or the right, depending on whether the current 
state is left or right moving. 

The two different descriptions are not quite the same; consider the computa- 
tions < q 'x i t x^ q ' and x^ i— > ( q 'x. In Birget's model, q' must be the same 
as q" . Using our model, they may differ. However, they can be seen to be equiv- 
alent; our model clearly contains Birget's model as a special case (the left and 
right moving state sets are the domains of o ; and o r respectively). Conversely, 
consider a model defined in our terms, together with a state q that is both left 
and right moving. We can then 'split q into 2 parts', qi and q r , and adjust 
the next state functions accordingly. Then Birget's single next state function 
is defined to be the union of our left moving and right moving next state func- 
tions (This construction is used in a 'non-determinism is (almost) equivalent to 
determinism' proof of J.-C. Birget for two-way automata 0, and a full proof of 
the equivalence of the above model with his can be found in Q| ) . 

To generalise the transition homomorphism t, we need to know when a com- 
putation is finished. In the one-way case it was immediate; a computation is 
finished when it reaches the left of the word of symbols from S. In the two-way 
case, there are four possibilities, depending on whether the pointer starts on the 
left or the right, and whether it finishes on the left or the right. Using this basic 
idea, J.C. Birget constructs algebraic models of two-way automata. For every 
word of the input alphabet, he defines four relations on Q: 

• w], consisting of the set of pairs (q' , q) for which there exists a compu- 
tation starting in configuration ( q 'w and finishing in configuration ( q ^w, 
with q rightmoving, and q' leftmoving. 

• [— w — consisting of the set of pairs (q',q) for which there exists a com- 
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putation starting in configuration and finishing in configuration vj( q \ 
with q and q' rightmoving. 

• [<— w— ], consisting of the set of pairs (q',q) for which there exists a com- 
putation starting in configuration and finishing in configuration ( q ^w, 
with q and q' leftmoving. 

• [w #], consisting of the set of pairs (q' , q) for which there exists a compu- 
tation starting in configuration and finishing in configuration w^ q \ 
with q left-moving and q' rightmoving. 

These relations, which he calls global transition relations, also feature implic- 
itly in the earlier work, '|2l|, by J. Shepardson. The point of J.-C. Birget's 
definitions is that, for any two words of £*, the global transition relation of 
their composite can be written in terms of their global transition relations, and 
composition in the monoid of relations. This is as follows: 

Theorem 1 Given a two-way automaton A = (Q = Qi U Q r , E, o), and u, v £ 
£*, then the global transition relations of the composite uv are defined in terms 
of the global transition relations of u and v, as follows: 

• [-uv ->] = [-v ->]{[u ^][^ v])*[-u -»], 

. [uv #] - [v #] U [-v -►][« #]([# u][u #])*[«- H» 

• [# H = [# u] U [«- u-][^ «]([« «])*[-« -»], 

• [<- ™-] = [<- «-]([# #])*[<- u-]. 

Where, for a relation R, its Kleene star is defined by R* — I U i? U i? 2 U R 3 U . . . 
□ 

The algebraic framework for these composition rules is a special case of a con- 
struction of Joyal, Street, and Verity, pcfl , which they refer to as the Int con- 
structionQ 

In this construction, the category Rel, that has all sets as objects and rela- 
tions between sets as arrows (so that the endomorphism monoid of an object X 
is the monoid B(X) of relations), is 'dualised' to form a category IntRel. This 
category has pairs of sets as objects. An arrow between two objects, say (X, U) 
and (Y, V), consists of four arrows in the category of relations, as follows: 




1 Although we follow the examples and notation of Joyal, Street and Verity (because they 
give the example of the category of relations as a special case) , the Int construction was first 
presented (in a different manner) in terms of logicalrnodels, in Abramsky and Jagadeesan's 
'New Foundations for the Geometry of Interaction' fcj]. The equivalence of the two construc- 
tions, together with the intuitive ideas behind the categorical construction - including the 
close connection with iteration - appeared in Abramsky's 'Retracing some paths in process 
algebra' Jlj]. 
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Composition of relations is then giving by a 'taking the union over all possible 
paths' construction. Two squares, as above, are composed vertically, and the 
union over all possible paths between bottom and top is constructed, as follows: 




cUd(qb)* qa 

X > u 



becomes e(bg)*a 




fUe(bg)*bh 



d{gb)"h 



This can also be written more concisely in matrix form as 



e f 
9 h 



a b 
c d 



e(bg)*a fUe(bg)*bh 
cUd(gb)*ga d{gb)*h 



This then gives context for Birget's equations for two-way automata. Define a 
function [ ] from the set of words on the input alphabet, £*, to the endomor- 
phism monoid of (Q, Q) in IntRel, by 



Theorem 2 The composition of [v] and [u] in IntRel is given by Birget 's equa- 
tions, so [vu] — [v] [u] . 

Proof This follows immediately by comparing the composition of IntRel with 
Birget's equations. □ 

The above construction shows that the map [ ] is a semigroup homomorphism - it 
is not a monoid homomorphism; the empty word A is mapped to the idempotent 

( ^ ' . This makes the image of S* under [ ] what ji~7| refers to as a 

local submonoid of the endomorphism monoid of {Q,Q). 

Unlike the one-way case, the value of [ ] for words of length 1 (that is, 
members of S) is not immediate from the definition. These can be found using 
a tool developed by J.-Y. Girard for linear logic, in i jUJ . 
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3.1 Girard's resolution formula, and two-way automata 

In |ll], [l2[ O , J.-Y. Girard constructed a novel series of representations of linear 
logic (see |l0| for an introduction to this logical system), called the Geometry 
of Interaction. This representation was in terms of matrices over monoids of 
relations. A common feature of all these was the resolution formula. This was 
defined in terms of matrices of relations (where, in the composition of matrices 
of relations, multiplication is interpreted by monoid composition, and addition 
is interpreted by union), to be 

Res(U, a) = irll(l - aU)' 1 ^ = nU(aU)*Tr, 

where it is an idempotent given by a {(a, a) : a 6 A}, for some A C N. The 
matrix of relations a was also assumed to be (in the simplest case) the anti- 
diagonal matrix ( !? \}i where 1 and are, respectively, the identity and 
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nowhere-defined relations on B(N). The connection of this formula with the 
theory of two-way automata is then as follows: 

Theorem 3 Let A = (Q, E, o ; , o r ) be a two-way automaton, and consider x S 
E. Define 

Qi = dom(oi) , Q r = dom(o r ) , j = ti(x) , k = t r (x) 

where ti and t r are the transition homomorphisms for [Q, E, o ; ) and (Q E, o r ) 
respectively. A matrix consisting of the global transition relations of x is given by 
the following version of Girard's resolution formula over the monoid of relations 
on Q : 



1 \ / k 

1 )[ j 



1q, o 

In, 



Res(U, a) 



Proof First note that a direct calculation will give 

l Ql k(jk)*l Ql l Ql (kj)(kj)*l Q 
lQr(jk){jk)*l Ql l Qr j(kj)*l Qr 

Conversely, the transitions of a two-way automaton on the symbol x can be 
represented as follows: 

j = tr{x) 

( \ 

X (l') 

k ; 

k=ti (x) 

All possible transitions from configurations of the form to configurations of 
the form ( q ^x are given by kj, (kj) 2 , (kj) 3 , . . . Hence, a;] is the intersection 
of {kj)(kj)* with Qi x Q r , and so [# x] = l Ql (kj)(kj)*lQ r . This is the top 
right entry of Res{U^a), as required. Similar considerations will give the other 
three global transition relations, [<— x—], [x v^], and [—a; — >] as the top left, 
bottom left, and bottom right entries respectively. □ 
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3.2 Interpretation of the 'reversing directions' symmetry 



The category IntRel is a compact closed category — the point of the Int 
operator is a canonical construction of compact closed categories. These are 
special cases of symmetric monoidal categories (we refer to |^3| for the theory of 
symmetric monoidal categories, and their coherence equations), where for every 
object A, there exists another object A v , called its (left) dual, satisfying: there 
exists an arrow from I to A® A v , and an arrow from A v (g> A to / (together with 
natural coherence conditions which were mathematically analysed in pl[.)p| 

These definitions imply the existence of duals on arrows, so that, for any 
arrow / : A — > B, there exists its dual / v : B v — > A v . In the category IntRel, 
the dual on objects is (X, U) v — (U, X) and the dual on arrows is given by 

(a bV _( d c \ 
\ c d ) ~~ \ b a ) 

The dual on arrows of this category then has the simple interpretation of in- 
terchanging the left and the right moving parts of a two-way automaton (i.e. 
taking o r as the left-moving next state function, and dually for o r ). Hence, if 
[w] is the global transition relation of w for the automaton A, then [w] v is the 
global transition relation of w for the automaton given by swapping the left and 
right moving parts of A. 



3.3 Summary of algebraic models of two-way automata 

It is worthwhile just to summarise the differences between algebraic models of 
one-way and two-way automata. They are both functions from the set of all 
words on the input alphabet; in the one-way case, a monoid homomorphism 
to the monoid of relations on the set of states Q and in the two-way case, a 
homomorphism to the endomorphism monoid of (Q, Q) in the compact closed 
category IntRel. What allows us to calculate them explicitly is that we know 
values for members of E; in the one-way case, these are immediate from the 
definition, and in the two-way case, these are given by Girard's Resolution 
formula. 

Note that a one-way (non-deterministic) automaton is uniquely specified by 
a monoid homomorphism, as above. However, a two-way automaton is not 
uniquely specified by such a homomorphism; the images of members of X are of 
a very special form. 

The definition of a one-way automaton has one symmetry, given by reversing 
the direction of arrows in a transition diagram. The mathematical representa- 
tion of this is the ( ) operation in the category of relations. The definition of a 
two-way automaton also has the symmetry given by reversing the direction of 
movement. The mathematical representation of this is the dual operator in a 
compact closed category. The 'reversing arrows' operation on the category of 

2 As could be deduced from this very suggestive notation, compact closed categories have 
been heavily used in theoretical physics — see |3l for more details. 
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relations generalises directly (by the Int construction) to the compact closed 
category IntRel. This makes IntRel what J. Baez refers to as a 'compact 
closed category with duality'; see H for more details. 



4 Generalising to bounded Turing machines 

The next observation that allows us to continue our generalisation process is that 
in the definition of a finite state automaton, the set of states has a distinguished 
role. Given a state and a symbol, we have a function that gives us another state. 
So, what we require in order to make this definition symmetric with respect to 
states and alphabets is another function (or two new functions in the two-way 
case) that takes a state and a symbol, and gives us a new symbol. We first 
consider how this generalises the definition of one-way finite state automata, 
and then extend to the two-way case. 

4.1 Generalising one-way automata to Mealy machines 

Given a (non-deterministic) automaton A — (Q,E, o : S x Q — > P(Q)), we 
wish to make this definition symmetrical between the state set, and the input 
alphabet. To do this, we introduce the output function * : S x Q — > P(S). The 
interpretation is that each state change has an output associated with it, so an 
input word of length n will give a set of output words of length n. Consider 
the following example, with state set {n, c} and alphabet {0,1}, where o and 



In c 



* are specified by 




respectively. The 



o ™ 
computation of R on the input 101101 starting in state n is then 



1 





1 


1 





1 


(») 




1 





1 


1 





(c) 


1 


output :0 


1 





1 


1 


(n) 





1 


output :1 


1 





1 


(c) 


1 





1 


output :0 


1 





0) 


1 


1 





1 


output :1 


1 


(n) 





1 


1 





1 


output :1 


c) 


1 





1 


1 





1 


output :0 



This gives the output word 011010, and ends in state c. As can be seen from this 
example, the action of this machine is to left-shift a binary string (i.e. multiply 
by two), and record if there is overflow (where c ='carry bit set' and n ='no 
carry'). Note that the above pair of transition diagrams define two 'automata 
with output', one with state set Q and input /output alphabet E, and the other 
with state set E, and input/output alphabet Q. In fact, the above example is 
equivalent to itself under this symmetry. 

Automata with output are know as Mealy Machines, or Mealy-type automata 
(see H for the general theory, and the related Moore machines, which are au- 
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tomata with output, where every state has an associated output, rather than 
every transition) . The examples we have been considering above are the special 
cases where the input alphabet is the same as the output alphabet. 

4.2 Generalising two-way automata to bounded Turing 
machines 

In the above sections, we took a model of applying finite functions to a finite 
set and considered in which ways the definition was asymmetric. We first gen- 
eralised to non-determinism by requiring that a 'reversing arrows' operation be 
well-defined, and then demonstrated how we could either generalise to two-way 
automata (by left / right movement symmetry) , or to Mealy machines (by state 
/ alphabet symmetry). 

We now wish to generalise by both at the same time, to get a model of a 
computing device that can move left and right, and overwrite its input as it 
goes. This will give us a model of computation which we refer to as a bounded 
Turing machine, which is a Turing machine where the read/ write head is unable 
to move over the end-marker of the tape. 

In the following section, we use a significantly different model of Turing ma- 
chines to the usual, as found in, for example [Q. The main difference is that 
we require the pointer to be positioned between cells on a tape, rather than 
pointing at a cell on a tape, as is usual (see for an explanation of the usual 
description). However, our description follows inevitably from the generalisa- 
tion process, and we feel justified in this approach, because the resulting model 
is algebraically tractable. 

Definition We define (our model of) a bounded Turing machine to be specified 

by 

• a state set, 

• Q, a set of symbols £, 

• two next state functions, o ; : £ x Q — > P{Q) and o r : Q x £ — > P(Q) that 
specify the left and right moving state changes, 

• two rewrite functions, *i : £ x Q — > P(£) and * r : Q x £ — > -P(£), that 
specify the left and right moving rewrites. 

The action of this machine is as follows: 

Consider a point in a computational process (a configuration, or instantaneous 
description) , 

• • • •Ei — 2-Ei — l ^ ^ • • • 

Then the set of next possible configurations is the union of all configurations of 
the form 

. . . Xi-2 ^ yxi . . . where b G x^i o ; a , ye a^-i a 
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and all configurations of the form 

. . . Xi_2%i-i z ^x i+1 . . . where c <E a * r Xi , z G a o r xi 



4.3 Algebraic models of bounded Turing machines 

We now construct algebraic models of the computations of bounded Turing 
machines. We cannot directly copy Birget's formula: in an attempt to construct 
algebraic models of bounded Turing machines - it makes no sense to write a 
composite like [to ^] [*— to—] in the context of bounded Turing machines; once 
the pointer has passed over the word w (that is the [<— to—] part), then another 
word has been written on the tape, so we cannot consider [# to] as a next step 
of the computation. 

Another, less serious, objection to copying Birget's model directly is the 
restriction of members of global transition relations to left-moving or right- 
moving states (recall that [<— to—] was defined to be the set of pairs (6, a) 
satisfying a computational condition, subject to the restriction that a and b 
were both left-moving). This is because, in our formalisation, it is the next 
state function that is split into two, rather than the set of states. 

Because of the above points, we pair words and states, and consider relations 
consisting of them, as follows: 
Definition 

For a bounded Turing machine T, and a natural number n, we define (<— n— ) 
to be the relation on S" x Q given by 



a 
u 



where there exists a computation of T starting in configuration u a , and leading 
to configuration b v 7 where words u and, by implication, v are of length n. We 
make the dual definition for (— n — >). 

We also require the other two possibilities: we define 



<# n) 



where exists a computation of T starting in configuration a u, and leading to 



{( 


' b ' 




a 






V 




u 





configuration 



where words u and v are again of length n. Of course, we 



make the dual definition for (n ^). 



We call these the computation relations for the bounded Turing machine T. 
Note that these relations give, for a bounded Turing machine T and a fixed 
tape length n, all possible computations of T that start and end at a boundary 
of the tape. What is then required is a description of how algebraically tractable 
these objects are. The first point is that we can write the computation relations 
in terms of themselves. This is not as trivial as it first appears; consider the 
following: 
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( 


' q' ' 




q 


) 




V 




u 





( 


■ q" - 




q 


) 




w 




u 





Proposition 4 Let T be a bounded Turing machine with state set Q and al- 
phabet E. Then the computation relations for words of length n satisfy the 
following: 

. <<- n-) = (# n){+- n-)((-n -)<«- n-»*(n #} 

• (— n — *■} = (# n)(-n —*■}((<— n— )(— n —>))*(« #) 
. <# n) = (# n>««- n-)<-n -))*<# n) 

• <n #) = (n #>«-n -)<«- n-»> #} 
Proof Consider 

" G (<-n-) , f [ q " 1 , [ 9 ' 1) e (n^) 
\\_ w j \_ v j J 

By definition of compostion in the category of relations, 

e (n ^)(^ n-> 

However, by definition of (<— n— } as the set of all right to left computations, 

€<«- n-> 

Hence (<— n—){n f^) C (<— n— }. However, as we are not restricting by left- 
moving or right-moving states, the identity relation / is contained in (n 
Therefore, we can also write 

(<- n-)(n #) = (<- n-) 

Similar reasoning applies to right to left and left to right computations, so that 

(«-n->C«-» -><«- n-»* 

and as the identity relation is a member of R* for any relation R, (<— n— ) = 
n— )((— n ^){^ n— })*. Finally, dual reasoning to the first identity will give 
us (<— n— ) = (# n— ). Putting these together will give us the identity 

<<- n-) = n}(- n-)((-n „-»*<„ 

The symmetry of the bounded Turing machine with respect to left / right 
movement will then give us the dual of this for free, so that (— n — >) = (# 
n)(—n —►)((<— n—)(—n — >))*(n #). This gives us the left to right and the right 
to left movements in terms of themselves and the other computation relations. 

It can then be shown by similar methods that n) = n){{<— n—)(—n — ► 
))*(v= : n), and duality with respect to left / right movement gives us (n v^} = 
(n #)((— n —►)(<— n— ))*(n This then completes our proof. □ 



( 






9 


) 




w 
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Definition 

As in the two-way automaton case, we can use these four computation relations 
to construct a member of the endomorphism monoid of (Q x E",Q x S n ) in 
IntRel as follows: 



(n) 



Q x S" 
(<-*-> 
QxE' 



x S n 



Q x E r ' 



We also make the formal definition that (0) is the identity at (Q x {A}, Q x {A}). 
We refer to (n) as the computation relation of the machine T on words of length 
n. 

As expected, we can write Theorem 4 as another 'summing over all paths' 
construction; this demonstrates a symmetry in the the definition of IntRel. 
In the definition of the composition of the endomorphism monoid of (X,X) 
in IntRel, there was no a priori reason to give vertical composition special 
status. For squares of this form, horizontal composition and summing over all 
possible paths is also a possibility. That is, the following is an alternative (and 
equivalent) definition of composition: 




aUb(rd)*rc 




uUt(dr)* ds 



b(rd)* s 



We now have two distinct compositions on endomorphism monoids of compact 
closed categories. Of course, taking the union over the set of all possible paths 
between points is independent of the way the paths were constructed, so given 

members a, 6, c, d of the endomorphism monoid of (X, X), then 

(c d) ^ W6 (t em P oraru y) write compositions linearly, and denote the 

vertical and horizontal compositions by o and • respectively, then the above 
becomes (a • b) o (c • d) = (a o c) • (6 o d). This is the interchange law, and is a 
one-dimensional way of representing a two-dimensional equationPl Proposition 
4 then states that 

Theorem 5 Computation relations of a bounded Turing machine are idempo- 
tent with respect to the horizontal composition. 

3 We refer to |(3| for examples and applications to topology, and |1 for applications to 
quantum field theories - in particular, using compact closed categories. 
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4.4 Calculating computation relations 

In the above section we derived, in terms of compact closed categories, formulae 
that computation relations must satisfy; however, we have not yet found any way 
of constructing computation relations, or of writing the computation relations 
of words in terms of computation relations of shorter words. We first need these 
relations for words of length one. This can be done using the same tools as the 
calculation of global transition relations for two-way automata: 

Theorem 6 The computation of a bounded Turing machine on words of length 
1 can be calculated in terms of a two-way automaton computation. 

Proof We define a two-way automaton that has a single character, say 1, for its 
input alphabet, has QxSas its set of states, and next state functions and > 
given by 1 (x, q) — (x *; q, x o ; q) and (x, q) > 1 = (q * r x, qo r x). It can be seen 
from the construction of this two-way automaton that if the pair ((y,p), (x, q)) 
is in [<— 1—], then there is a computation of our bounded Turing machine that 
starts in the configuration x q and goes to in the configuration p y. Similar re- 
sults apply for [—1 — >], 1], and [1 So we can calculate the computation 
relations for words of length 1 using a version of Girard's resolution formula (see 
the discussion of algebraic models of two-way automata) that does not use the 
idempotent it (since we do not restrict to 'leftmoving' or 'rightmoving' states )0. 
□ 



What the above trick does, intuitively, is to 'push all the computation onto the 
set of states and the next state function'. However, we cannot immediately 
reconstruct the behaviour of a bounded Turing machine using Birget's compo- 
sition. The above assumes that we are considering words of length 1, and any 
composition using Birget's formulas will at most give us more information about 
the behavior of words of length 1. 

To calculate the computation relation of (m + n) in terms of (n) and (m) , 
note that in general, (m) and (n) are members of two different monoids, and we 
require a result that is in a third monoid. For clarity, we denote the set E™ x Q 
by C n , and refer to the monoid B(C n ) 

What we require is functions that take relations in B(C„) to relations in 
B(C m+n ), for all n 6 N. We define two functions, as follows: 
r rn : B(C n ) — > B(C m+n ) is defined by 



q 

wv 



q 

wu 



q 

V 



q 

u 



G S , 



and dually, l n : B(C m ) — > B(C m + n ) is defined for all m G N by 



L(T) 



q 

vw 



q 

uw 



q 

V 



q 
u 



e T , weS" 



4 This variation on the resolution formula is also used in the Geometry of Interaction series 
of papers, where it is called the execution formula. However, a discussion of the similarities 
will take us too far from our original aim, so we refer to |12|. 
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Lemma 7 

(i) The functions l n : C a — > C a +„ and r m : C a —> C m +a are homomorphisms 
for all a £ N. 

(ii) Let Y be a relation in B(C n ) and let X be a relation in B(C m ). Then 
l m (Y)r n (X) = 




Proof Both the above results follow directly from the definition of compositio: 
in monoids of relations, and from the definitions of l m and r n . □ 



Now consider two right-to-left computations of a bounded Turing machine; the 
first on a word of length m, and the second on a word of length n. Assume 
the first one takes configuration y q to configuration q z. Similarly, the second 



takes configuration u q , to configuration 



Then it is immediate that there 



exists a computation of our bounded Turing machine, on a word of length m + n 
that from configuration yu q to configuration q zv. We draw this as 



Vn 



•••2/1 

...Z\ 



U n ...Ui 
V n ...Vi ' 



z m ... ziv n ...vi 



JJn 



■ ■ 2/1 "r, 



.til 



Comparing this with Lemma 1 1 above then gives the computational interpreta- 
tion of the I and r functions. 

We can apply l n and r m to the 4-tuples of relations of B(C n ) that make up 
members of IntRel(C n ,C n ) to form two functions R m : IntRel(C n ,C n ) — ► 
IntRel(C m+n ,C m+n ) and L n : IntRel(C m ,C m ) — > IntRel(C m+n ,C m+n ), in a 
natural way, as follows: 



a 



Rn 



m+n 



Cn 



<<-«>-> 



n 



r m ((*-w-)) 



a 



m+n 



a 



The definition for L n is similar. The main result of this paper then follows from 
these two definitions: 

Theorem 8 Consider a bounded Turing machine T, and let its computation 
relations for words of length m and n be given by (rn) and (n) respectively. 
Then its computation relations for words of length m + n are given by 

(m + n) = R m ({n)) o L n ((m)) 

where o denotes the vertical composition in the monoid of (C m+n ,C m+n ) in 
IntRel. 
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Proof In the following proof, we denote r m ((<— n—)) by r((<— n— )), for sim- 
plicity, and similarly for I. 

We first consider the case of (<— m + n— ). By the above example, 

Z((<- m-))r((<- n-)) C (<- m + n-) 

However, we can say more; consider a bounded Turing machine computation 
on a word of length m + n, and mark the intersection between cell m and cell 
m + 1 (counting from the left) by the symbol @. So, our cells arc numbered 

12 3 ...m® m+1 ... m + n 



( 


q 




p 


) 




zv 




yu _ 





Now consider a computation of T on this tape that starts on the right and 
finishes on the left, and count the number of times the read / write head passes 
through the point @ (The crossing number). Also assume that this computation 
starts in state p and ends in state q, and takes an input word yu to an output 
word zv. By the above example, if the read / write head passes through the 
point @ once, then 

([£]'[£]) e«<-m-»r«-n-)). 

Similarly, using lcmma7, if the read head passes through the point @ three times 
(clearly, it cannot pass through an even number of times on its way from the 
right hand side to the left hand side) then we must have that 

e ro-»r«^ n))l((m ^»r««- n-». 

Then if the read head passes through the point @ five times 

G Z««- m-»(r«# n))l{{m ^))fr{{^- n-)). 

In general, whatever the crossing number of the point @, 

e m-))(r((^ n))l((m ^)))V((^ n-)) 

for some natural number i. Therefore, 

(*- m + n-) = m-»(r«^ n))l((m ^»)*r«^- n-» 

The left / right moving symmetry gives us the dual of this with no further 
calculation, so 

<-m + n = r«-n -))(/((^ m))r«n ^»)*/«-m -)) 

Right to right movement is dealt with in a similar way; the main point to 
note is that if the read head does not pass through the point @, then the contents 



( 


q 




V 


) 




zv 




yu _ 





( 


q 




p 


) 




zv 




yu _ 
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of the tape to the left of the point @ cannot change (this is the interpretation 
of the set of all possible words of S m being put on the left of words of S™ by 
the r„ homomorphism) . The case when the read head does pass through this 
point is then dealt with by a similar crossing number argument, to give 

(m + n #) = r«n #» U r((-n -+))l{{m #»(r«# n))l((m #}))*r(<- n-» 

Again, duality gives the left to left movement as 

to + n) = r((^ to}) U Z«<- m-))r((^ n))(/((m ^))r((^ n)))*Z«-m ->)). 

Comparing the above four terms with the vertical composition, o, of IntRel 
gives (m + n) = R m ((n)) o L n ((m)), as required. □ 

Corollary 9 From the computational interpretation, it is immediate that if 

A e IntRel((C n , C n ), (C n ,C n )) , B e IntRel((C m , C m ), (C m ,C m )) 

are computation relations for a bounded Turing machine T, then 

L m (A)R n (B) = L n (B)R m (A). 

That is, they both give the computation relations for the behavior of T on a tape 
of length m + n. □ 

Although this is a necessary condition for computation relations to satisfy, it is 
not known whether this is a characterisation of computation relations. 

4.5 Bounded Turing machine models as monoid homo- 
morphisms 

We demonstrate that the map ( ) can be considered to be a monoid homomor- 
phism, as follows: 
Definition 
We define 

oo 

T x = |J Intrel((a, C\), (C\, C\)) x {i} 

i=0 

and define a composition on T^ by 

(B, to) * (A, n) = (R m (A) o L n (B), m + n) 
where o is the vertical composition of Intrel((C m+n , C m+n ), (C m+n , C m+n )). 
Lemma 10 (Too,*) is a monoid. 

Proof it is immediate by Lemma 7 that * is associative. Also, the identity of 
the monoid at (Q x A, Q x A) is an identity for this composition. Our result 
then follows. □ 
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Theorem 11 Let T denote a bounded Turing machine. The map t : N — > 
defined by t{n) = (n) is a monoid homomorphism. 

Proof By definition, t(X) is the identity of Too, and associativity follows from 
theorem 8. □ 



4.6 Extracting information from computation relations 

An objection that could be raised to the definitions of this paper is that the 
computation relations for a bounded Turing machine give no information about 
specific computations, as they describe all possible computations on a given tape 
length. We now demonstrate how information about specific computations can 
be extracted from computation relations. 

Let T be a bounded Turing machine, and consider its computation relations 
on a tape of length n. Information about computation that go from left to right 
can be extracted from the relation (<— n— ). Consider q G Q and u <E S n . By 
construction, 



q 

V 



-> 



q 

u 



implies that u q i— > q v is a computation of T. 
Similarly the composition 



(-« 



{( 


u 




u 


)} 




q _ 


5 


1 _ 





will be the set of pairs y v > u J satisfying q u i— > v q is a computation 
ofT. 

If we restrict by an idempotent on the left hand side, instead of the right, then 
the composite 



q 




q 


)} 


u 




u 





will be the set of pairs 



q 

V 



(<- n-) 



satisfying q v \— > u q is a compu- 



tation of T. So, we can also specify the final state of a computation, and use 
the computation relation to calculate the set of initial states that lead to it. 

We can, of course, calculate with the other computation relations in a similar 
way. 



5 Conclusion, and discussion of methods 

In the above sections, we have demonstrated how symmetry ideas are useful in 
the basic level of theoretical computing. It is encouraging to see the emergence 
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of the same mathematical tools that are used in both linear logic and theoret- 
ical physics. A natural point that is missing for the above is any discussion 
of generalisations of the syntactic monoid of an automaton - that is, of the 
languages recognised by bounded Turing machines. However, this appears to 
be a significantly more complicated subject; the question of whether bounded 
Turing machines have the same recognising power in the deterministic and non- 
deterministic case is still undecided (See p. 229), and a solution, whether 
positive or negative, appears to have important consequences. Constructing 
algebraic models of transitions is just the first step in answering this question. 

The way in which the mathematical symmetries follow the intuitive ideas 
of dualising automata is apparent in the first two cases. For the generalisation 
to non-deterministic automata, every relation R can be written as G~ 1 F for 
functions F, G. For the generalisation to two-way automata, the mathemati- 
cal representation is Joyal, Street, and Verity's Int construction, where every 
object A is given a dual A v . However, there is no analogous mathematical rep- 
resentation for the generalisation to either Mealy machines, or bounded Turing 
machines. Not only that, but the monoid can be thought of as taking a 
copy of the endomorphism monoid of (Q, Q) at each word in S* — this is much 
more that a dualising process. 

In the above generalisations of finite state automata, we were (at least par- 
tially) motivated by our end-point; we already knew which models of compu- 
tation we expected to construct. However, there were other possible routes to 
take: 

• For the 'reversing arrows' symmetry, the replacement of functions by rela- 
tions was possibly too much of a generalisation. An alternative possibility 
would be to allow partial injections — see Q for the resulting algebraic 
theory, under the name of inverse semigroups — and restrict them as fol- 
lows: partial injections from the same state would have distinct domains, 
and partial injections to the same state would have distinct images (in the 
deterministic case, we would also require the union of the domains and of 
images of partial functions at a state be full). The two-way case would be 
slightly more complex, but the conditions required (that is, the conditions 
for an inverse compact closed category of partial injections) have already 
been found, in the context of the Geometry of Interaction, in . 

• For the state / alphabet symmetry, an alternative possibility would be to 
have the same set for the states, and the alphabet. However, although 
this is at first sight simpler, it means that a string of function symbols 
fgh is ambiguous; if f(g) = k, and g(h) = I, this could denote either k(h) 
or f(l). Alternatively, it could denote the function given by applying h, 
then g, then /. Abandonment of associativity would make mathematical 
models significantly more complex. 

• It would also be reasonable to require, not only a function o : £ x Q — > Q, 
but also a function from Q to £ x Q, and similarly for * : £ x Q — > S. 
Unexpectedly, I recently became aware of an application of this (in the 
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one-way case) in the context of functional programming and automatic 
program transformation, in the work of Martin Erwig, B. 
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